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We construct a non-Markovian canonical dynamical map that accounts for systems correlated with 
the environment. The physical meaning of not completely positive maps is studied to obtain a theory 
of non-Markovian quantum dynamics. The relationship between inverse maps and correlations with 
the environment is established. A generalized non-Markovian master equation is derived from the 
canonical dynamical map that goes beyond the Kossakowski-Lindblad Markovian master equation. 
Non-equilibrium quantum thermodynamics can be be studied within this theory. 



I. INTRODUCTION 

The theory of open quantum systems was first intro- 
duced as the quantum analogue of classical stochastic 
processes [l|. The evolution of a system that interacts 
with outside degrees of freedom is fully given by a dynam- 
ical map that corresponds to a quantum stochastic pro- 
cess. The state, the environment and their correlations 
change with time. If the environment is assumed not to 
react on the system, the Markov approximation can be 
taken in which these correlations are discarded to derive 
the Kossakowski-Lindblad master equation 0, 3, 4]. This 
theory extends quantum mechanics beyond Hamiltonian 
dynamics, and has been crucial to the study of quantum 
thermodynamics for phenomena such as decoherence || . 

The Markov approximation is unreasonable for many 
physical phenomena. Even if the environment is large 
compared to the system, it might still react on the system 
for very short times. For short times, the system can only 
couple to a few environmental degrees of freedom. These 
will act as a memory. Short time scales in experiments 
often show environmental memory effects. For example, 
in the case of spin-echoes a decay can be partially undone 
by exploiting environmental memory effects [6j]. Also, 
non-Markovian quantum effects may play a role in the 
energy transfer in photosynthesis [2]. 

Modeling non-Markovian open quantum systems is 
crucial for understanding these experiments. The 
Kossakowski-Lindblad master equation proves to be in- 
adequate. Extensions to the theory of open quantum 
systems to go beyond the Markov approximation have 
been developed but the theory is incomplete. 

In this paper we develop a generalization of open quan- 
tum systems to states correlated with their environment, 
leading to non-Markovian dynamics. 

We review the theory of stochastic processes for quan- 
tum systems in SectionQll Different forms of the dynami- 
cal maps, their inverses and properties are discussed. To 
highlights the limitations of the Kossakowski-Lindblad 
master equation, we review the conditions and approxi- 
mations necessary to derive it from the dynamical map 
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are described in Section ITLTl In Section ITVl we study how 
initial correlations naturally limit the domain of valid 
physical states and not completely positive dynamical 
maps can arise. We construct a canonical dynamical 
map is constructed that is non-Markovian, with the un- 
derstanding that the compatibility domain of not com- 
pletely positive dynamical maps is connected to correla- 
tions of the system with the environment. In Section fVl 
we derive the generalized non-Markovian master equa- 
tion. The equation is local in time. A canonical em- 
bedding map dynamically determines how the system 
is correlated to the environment at all times. In Sec- 
tion IVII we introduce irreversibility by discarding terms 
of higher order in time. Truncation does not eliminate all 
the memory effects of the environment and correspond to 
non-equilibrium quantum thermodynamical phenomena. 
We discuss the connection of the non-Markovian master 
equation to previous instances of specific non-Markovian 
master equations and make the concluding remarks in 
Section En] 

The theory of non-Markovian open quantum systems 
we developed in this paper provides a simple way to de- 
scribe decoherence phenomena beyond the Kossakowski- 
Lindblad master equation. 



II. QUANTUM STOCHASTIC PROCESSES 

The density matrix p describes the most general quan- 
tum mechanical state. The density matrix must have 
unit-trace, Hermiticity, and non-negative eigenvalues 
[lH . These are related to the properties of classical prob- 
ability vectors and allow us to interpret the expectation 
values of density matrices as physical observables. If we 
write the density matrices using tensor notation, a quan- 
tum stochastic process acts like a classical stochastic pro- 
cess, as described in Appendix lAl A quantum stochastic 
supermatrix A can be defined to describe the most gen- 
eral evolution of an initial density matrix p(i) to a final 
density matrix p(f), 

p(j>)rs ^ P(/)r's' = A r / s / rs p{%) rs . 

The supermatrix A acts on the density matrix p like if it 
was a vector, p (/) = A • ~p(i). The quantum stochastic 
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supermatrix has the properties: 



x r /X s i h± r i s ' _ rs y r y s > 0. 



(la) 
(lb) 
(1c) 



The first property guarantees the preservation of the 
trace, the second property preserves Hermiticity, while 
the last property imposes the condition that non-negative 
density matrices are mapped into non-negative density 
matrices and may be referred to as positivity |l[ . In Sec- 
tion [IVE we study physical situations where the posi- 
tivity condition must be relaxed. 

We observe that in this form the composition of two 
maps, A'* A, is the matrix multiplication of their super- 

A pseudo-inverse A can be 



matrices 



defined such that: 



r s ,r s" 



^r" s" ts ■ 



//A // 
ft" JTi-r" .s 



'(r f s'),(rs) • 



(2) 



The matrix A is positive only on a convex domain con- 
sisting of a subset of all density matrices. Its action is 
only well-behaved on the subset {//} of density matrices 
of the form p ' = A • p for all {~p}. This subset is called 
the compatibility domain. Outside the compatibility do- 
main, the positivity of the density matrix need not be 
preserved by the inverse map. [3^ | 

We simplify the properties of A by an index exchange 



of the form 



and obtain: 



J r,s ) 

TO * 

^s' s,r f rf 



x*,y*M r , rtS , s x s >y s > 0. 



(3a) 
(3b) 
(3c) 



Hermiticity is now guaranteed because the map B itself 
is Hermitian. However, in this form the action of the 
superoperator B is not simply matrix multiplication on 
a vector p as it was in the A form. Instead, the map B 
acts in the following manner: 



p{i)r 



P(f)r>s> = 



P(i)rs, 



or just p(i) — > p(f) — B p(i) for short. In this form, the 
composition of two maps M'-kl 



i r'r",s's" ln 'r"r,s"s, 



which 



is not matrix multiplication as it was in the A form. The 
inverse B can be calculated from A by exchanging the 
indices, inheriting its compatibility domain. 

Now, we decompose B into its eigenma- 
trices and real eigenvalues, ^ r 'r,s's p(i) r s = 
J2 a ^( a ) C(a) r ' r p(i) rs C*(a) ss >. The action of the 
map is: 



(4) 



Note that {C a } are linearly independent and trace or- 
thonormal, Tr[C|,Cg] = for a ^ (3. Hermiticity of p is 
automatically preserved by the multiplication on the left 



and right. The trace of p is preserved by the condition 
J2 a ^aC^Ca = 1. The positivity condition is still only 
implicit. A stronger condition, complete positivity, is very 
natural now. Complete positivity is defined as having all 
non-negative eigenvalues A Q > [HI, U3. Complete pos- 
itivity is a condition on the map itself, while positivity is 
a condition on the action of the map on density matrices. 
Much attention has been given to this class of maps, but 
confining quantum evolution to them has proven to be 
too restrictive [3 [l5|, [l6|, [T3, EH El • Inverse maps are 
generally not completely positive [201 ] . In this paper we 
will use the A form, B form and its eigen-decomposition 
to show how the complete positivity condition incompat- 
ible with non-Markovian open quantum systems. 



A. Dynamical Maps of Open Quantum Systems 



The evolution of a closed quantum system is generated 



by a unitary operator ?7( t , = e 



-i{t f -ti)H 



|40|. The dif- 



ferential form of the evolution is given by the von Neu- 
mann equation, p(t) = —i[H,p(t)]. The evolution can 
also be viewed as a stochastic process through a unitary 
map, 



U 



(t f \u)P{U) = U( tj \u)P(ti)u{ tflti) = p(t f ). 



This map is completely positive. The inverse of this 



map, U iu \t f ) = v (tflu) = u iu \t f ) 
density matrices as its compatibility domain, making it 
bi-stochastic. 

We are interested in the evolution of an open quantum 
system. In this case, the total state p S£ has a part that 
is accessible to us, the system S, and one that is inacces- 
sible, a finite-dimensional environment £ . The density 
matrix of the system space is found by tracing-out the 
environmental variables, i] S — Tr^ [p S£ ] (HI- If we only 
monitor the evolution of the system, it is generally non- 
unitary and best described by a dynamical map of the 
form: 



U 



has the whole set of 



1>(t f \u)V(U) = Tr £ 



U, 



(t/l*. 



(tf\U) 



V(tf). (5) 



In the full space, the evolution is given by the unitary 
map U, while in the reduced space we get a more com- 
plicated evolution: 



p(U) < — > p(t f ) = U { t f \u)P(^) U (t f \u 

i i 
V(U) — v(tf)=Tr £ \p{tf)]. 



(6) 



The top level of the diagram represents the unitary evo- 
lution of the total system. The lower level is the reduced, 
open system, evolution. To go from the total space to the 
reduce space, or "down" as indicated by the arrows, we 
use the trace map Tp S£ = Ti£p S£ = n. 

Note that there is no arrow to go from r\ — > p, or 
"up" . There is no map that inverts the trace such that 



3 



Sir" 



„S£ 



Inverting the trace would depend on a 



kernel that comes from correlations of the system with 
the environmental variables. In Section liVDI we will de- 
rive a pseudo-inverse map that inverts the trace based 
on the physical considerations of the dynamics of the to- 
tal state. With such a map, the dynamical map for the 
process from rj(ti) — > i](tf) can be expressed as the com- 
position of three maps, 



Htf\u) 



(t f \u: 



(7) 



First, the trace is inverted to go from the reduced to the 
total space, then a unitary map evolves the total state 
and finally a trace reduces it to the system part of the 
space. When tj = ti, there is no evolution and the map 
is just unity. How to properly define a pseudo-inverse 
map that connects the reduced space to the total space 
for all times is one of the main results of this paper. 



B. Initially Uncorrelated States 

A standard assumption for the evolution of an open 
system of the form Eq. (|SJ) is that the system and envi- 
ronment are at the initial time in a Kronecker product 
of two density matrices, p S£ {ti) = i] S (ti) ® t £ . Uncou- 
pling a system from its environment may not be accom- 
plished in experiments plj . This very restrictive assump- 
tion can be shown to lead to dynamical maps that, in the 
form of Eq. (0J) have non-negative eigenvalues [22]. This 
is proven by breaking the corresponding dynamical map 
into the composition of several completely positive maps, 
as in Eq. (J7J) . The reduction at the end of the evolution T 
and the unitary map U are both completely positive. The 
map T can be defined as an embedding map E [3, HH 
that takes the system state at the initial time, and em- 
beds it into the system-environment space: 



T 



(8) 



Since r has positive eigenvalues, the embedding map can 
be written as E (77) = (l s <E> Vr^)f] S (t s ® Vt^)\ which 
is of the form of Eq. ^ with non-negative eigenvalues. 
The dynamical map that takes a state without initial cor- 
relations with its environment is the composition of three 
completely positive maps: embedding, unitary evolution, 
and reduction. Initially uncorrelated states are not the 
only states that can give rise to completely positive maps 

m 

The embedding map presented here is only applicable 
to the system at time ti. At other times it might have 
developed correlations with the environment and not be 
of the product form. A generalization of this map for all 
times will be presented in Section [IV Dl 



C. Example 

To illustrate the relationship between the different 
forms of the map, we compute a simple example of a 
two-level system, a qubit, represented by the Bloch vec- 
tor a . Its most general transformation in the affine form 
M is: 



\t } ) = R { 



t f \U 



~a(U) 



(9) 



where the matrix R squeezes and rotates the Bloch vec- 
tor, and the vector V translates. For this example, we 
focus on the particular case where the system interacts 
with a two- level uncorrelated environment r = il. The 
total initial state is: 



K 1 ' 



aj(t )a 



(10) 



where summation over the repeated index j is implied, 
and <7j are the Pauli spin matrices. The system S is de- 
scribed by the Bloch vector a . The environment at the 
initial time is fully mixed. If we assume a unitary opera- 
tor that depends on the Hamiltonian H = J^j ® a f > 
the evolution of the Bloch vector is: 



~ct(t) = cos (t — to) ~a(to), 



(11) 



which is a uniform squeezing with no translation [25j |. 
This interaction was chosen because it swaps the system 
with the environment at periodic intervals, thus storing 
the system information in the environment and then re- 
turning it. As time changes, the state is pinned to the 
fully mixed state and grows again into the full state pe- 
riodically. 

The evolution can be treated as a map from rj(to) — > 
r/(t) with the form from Eq. ([S]). If the density matrix 
rj{t) — i (1 + a,j(t)<jj) is written as a vector, 



t(t) 



l + a 3 (f) 
ai(t) — ia 2 (t) 
ai(t) + ia 2 (t) 

l + a 3 (i) 



the evolution is a stochastic matrix transformation 
~v(t) = A (t|t ) ' "»f (*o), where 



K*l«o) 



/ l + c 2 



V 1-c 2 







1-c 2 
2c 2 
2c 2 

1 + c 2 



with c = cos (t — to). By index exchange, we get the map 
in its Hermitian form: 

/l + c 2 2c 2 \ 

%*o) = 2 C 1-c 2 ' (12) 
\ 2c 2 1 + c 2 / 

By rewriting the map in terms of its eigenvalues and 
eigenmatrices, r)(t) = Yf a =o "M* _ MCa^o)^ with 
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A (£-io) = i(l + 3c 2 ), C = -J=l, 

Ai,2,3(i - M = g _ ° 2 ) ' ^1.2,3 = y| ' 1 ' 2 ' 3 ' 

we confirm that it is completely positive and trace pre- 
serving. 

The process is reversible. Since the environment is 
finite dimensional, there are Poincare recurrences. Also, 
note that even if this map is expanded in a Taylor series 
for t rs to, where: 

c 2 = cos (t - t f = 1 - (f - t f + ..., 

there are no terms of first order. To get irreversibility 
from this example, we will need to perform and approx- 
imation. In the next section, we review the approxima- 
tions necessary to obtain the Kossakowski-Lindblad mas- 
ter equation. 



III. KOSSAKOWSKI-LINDBLAD MASTER 
EQUATION 



the evolution is completely positive. In addition, we must 
perform a time rescaling to get the Kossakowski-Lindblad 
master equation from the dynamical map. With these, 
we obtain the equation: 

drj 



dt 



= -i[H,rj\ 



£ 2 



(2L af? Lt - L^r? - 7?Lt L 



(15) 



The details of this derivation are given in Appendix [Bl 

Altogether, these restrictions can describe dissipative 
processes at the expense of discarding non-Markovian 
memory effects and correlations with the environment. 
The Markov approximation can lead to unphysical re- 
sults 27[. States with initial environmental correlations 
can have not completely positive dynamics [28| . The dis- 
carded higher orders of t introduced irreversibility into 
the equation [2^ |. giving rise to thermodynamic effects. 
The destruction of the memory effects make the present 
independent of the past and the state independent from 
its correlations with the environment [30| . These limit 
the physical situations where the Markov approximation 
can be applied. We question each these assumptions. 



So far we have only discussed reduced Hamiltonian 
dynamics on quantum systems where no information is 
lost. In this section we discuss the Kossakowski-Linblad 
master equation in order to model monotonic decay of a 
quantum state. The master equation can be interpreted 
as the time-derivative of the dynamical maps after a se- 
ries of assumptions and approximations. 

A dynamical map of a system that was uncorrelated 
from the environment at to might developed correlations 
through time, its history reduces the allowed set of states 
at time t\ such that, 

B (t 2 |to) ^ B (* 2 |ti) * B (ti|to)' ( 13 ) 

The Markov approximation, assumed to be valid for short 
times, makes 

B (t 2 |t ) ~ %2|tl) *%i|t )- ( 14 ) 

The maps now form a dynamical semigroup. This ap- 
proximation was used by Kossakowski to derive a fam- 
ily of equations of motion for open quantum system 
@, [H, 0] that lead to irreversible behavior. The solutions 
to Kossakowski-Lindblad master equation often lead to 
exponential decays. Exponential decay solutions are a 
consequence of the approximations necessary to derive 
the master equation, and are connected to equilibrium 
quantum thermodynamics. The deviation from exponen- 
tial for short times is the quantum Zeno effect [261 ] . 

We need to take the Markov approximation to obtain 
the approximated composition property from Eq. (|14[) in 
order to properly define the derivative of the dynamical 
map at all times. Also, we must assume that the system 
is initially uncorrelated from its environment, and thus 



A. Example 

To illustrate the approximations made to obtain the 
Kossakowski-Lindblad master equation we study an ex- 
ample. We derive a thermodynamic decay from the colli- 
sion model developed by Rau [3l[ . Consider the evolution 
that leads to Eq. (TTTj) . We can model decoherence by 
treating the total environment as a stream of {r^}, where 
each of them interact sequentially for a short average 
time T . This corresponds to acting with the dynamical 
map from Eq. (112[) in sequence: 

rf -> l (tn , tB _ *B Ctn _ l!t „_ 2) * . . .*B (tl , 4o) (v S ) , 

where each time interval has duration T = t m — t m —\. 
After N interactions the total time t — NT has passed 
and the density matrix has the form: 

V (t) = ±(l s + co S (T) 2N a 3 (to)<Tf). 
The shrinking factor can be rewritten as 

cos(T) 2Ar = e-** ln (^l). 

To get a fully thermodynamic decay, we must rescalc the 

short-time regime T such that y In ( cos 1 ( T - ) ^ ~ 7, where 

7 is a constant. This rescaling gives an exponential decay 
of the form: 

r,(t) = i(l s + e-^-^ aj (t )af). (16) 

This evolution can be written as a first order differential 
equation, 77(f) = 7 (|l — 77(f)). 

If we choose Lo = y^Jl and L a = y^^a for a > 0, 
the differential equation is of the form from Eq. (jT5j) . 
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IV. NON-MARKOVIAN DYNAMICAL MAPS 

The Markov approximation is incompatible with a gen- 
eral theory of open quantum systems. In the previous 
section, we discussed how this approximation was taken 
to obtain an approximated composition property from 
Eq. (TTi|) that permits the definition of the derivative 
of the map. By relaxing these assumptions, we can al- 
low for not completely positive dynamical maps and thus 
account for physically meaningful correlations with the 
environment. We obtain the composition property by 
accounting for correlations. 

A. Initially Correlated States 

The tensor product of a system and environment state 
can be evolved to develop correlations. Their dynamical 

I 



maps are computed as before, 



p{to) = v{to) ® T PO2) = U (t3 |t ) (p(*o)J 

I i ' (17) 

V (t ) -> B (t2 | to) (^o)) =v(h)- 



To define the map B(t 2 |t ) we know the composition of 
three maps. First, one that inverts the trace at to, to have 
an arrow that goes from rj(to) — > p(to)- Then we have a 
unitary map U( t2 u ). At time ti we have a trace to go 
from p(t ) — » T)(to). In Eq. |[T7|, to go from 77(^0) — » v(h) 
we start on the bottom-left, go up, then to the right, and 
then down. If we introduce an intermediate time t\ the 
evolution becomes, 



p(*o) ^ p(*i)=U (tl |to)(p(*o)) " p(t2) = V { t 2 \t 1 )(p(h)) 

II I (18) 

»?(to) B (tl | to) (T;(*o))=»7(ti) — » l»C*al*0 = *7(*a)- 



B( t2 | to ) as well as B( 4l | to ) are completely positive, but 
B( t2 | tl ) might come from a p(t\) 7^ f?(ii) <8> t. Not com- 
pletely positive maps can come from system initial en- 
vironmental correlations, such as entan glem ent fLlj and 
more generalized quantum correlations [18j |. 

To develop a prescription to consistently describe maps 
for initially correlated states, we need to find the in- 
verse of the trace at time ti, Tp(ti) — ?j(ti), such 
that rj(ti) — ► p(ti), use the inverse to find to dynam- 
ical map. Inverting the trace was accomplished in Sec- 
tion [TlB] by introducing a completely positive embedding 
map, Eq. JHJ). For initially correlated states it is neces- 
sary to relax the positivity condition. Complete positiv- 
ity is a stronger condition than positivity, and will need 
to be relaxed as well, as was proposed by Pechukas [3]. 
We study how these not completely positive maps in- 
verse maps have a physical interpretation if we account 
for non-Markovian quantum dynamics. 



B. Inverse Maps 

An inverse map connects the dynamics of the reduced 
state to the total state. With it, the composition prop- 
erty of the dynamical map can be found without approx- 
imations by exploiting the group property of the unitary 
maps U in the total space. The correlations that exists 
at time t\ can be mapped back to a time tg when they 
were uncorrelated. Correlations at t±, by definition, limit 



the valid domain of states at that time. Identically, the 
history from [to, ti] can limit the domain at time t%. We 
treat correlations as a consequence of the memory effects 
from [to, ti] . Non-Markovian dynamics are obtained from 
system variables that are correlated with outside vari- 
ables. 

A consistent way to define maps after they have de- 
veloped correlations is with inverse maps. Inverse maps 
have been studied before [20(, but here we consider the 
pseudo-inverse from Eq. J2} and find a matrix inverse 
A( t .| t/ ) of the map A( f/ | t .) that evolves the state back- 
wards in time. To define the map, additional information 
is necessary. This additional information is the history 
from the unitary evolution. From this, the inverse dy- 
namical map B( tj | t ,-j can be found, which is generally not 
a positive map. B( ti | t ,-j can only be meaningfully applied 
to the set B( t .[t^viU) f° r all density matrices {r](ti)}. 
The compatibility domain is identical to the set of states 
compatible with the history from [to,£i]- States outside 
the compatibility domain will be inconsistent with its 
history, and when its evolution is reversed it may not be 
mapped to a valid physical state. There is no reason for 
these maps to be positive, much less completely positive. 
On the contrary, history effects create correlations that 
limit the domain of validity. 

Experimentally, inverse maps can be found from suf- 
ficient knowledge of their forward counterparts. Since 
we are considering finite-dimensional environments, the 
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evolution will have Poincare recurrences in it. The re- 
currence time gets longer as the environment gets larger. 
The evolution of a system state of N dimensions can al- 
ways be modelled with an environment with iV 2 dimen- 
sions [32(| . This makes the number of parameters finite 
and the problem tractable. A related way to determine 
the inverse maps to know its forward counter part to high 
enough orders in time. Such as scheme for a one-qubit 
system coupled to a one-qubit environment was devel- 
oped in [33l ] . There a finite number of derivatives at the 
initial time almost fully characterize the evolution of the 
total state. Another procedure for determining the total 
Hamiltonian of qubit systems is given in [34j . 

In realistic circumstances, full knowledge of the map 
may not be accomplished. In Section I VII we will show 
how incomplete knowledge of the evolution leads to ir- 
reversibility. Now, we use the inverse map to derive the 
canonical dynamical map that accounts for correlations 
with the environment. 



C. Canonical Dynamical Map 

With the inverse map B, we can now define a canonical 
dynamical map B c for states win initially environmental 
correlations. The knowledge necessary for finding the 
inverse map are the additional variables needed to extend 
a system space of a non-Markovian evolution. 

We compose the maps to find the evolution described 
in Eq. (TT5)) from t\ — > ^ as in Fig. |T]). First, we map 

^ \CP 

/ — CP ^\ 



without need of any approximations. 

It has been implied that fo < t\ < £2 5 but this needs 
not be. If t\ = to, the original completely positive map 
is obtained. If to < t\ but £2 = £0, we obtain 

B 0to|ti) = B (*o|to) * B (*o|ti) = %ol*i)> ( 21 ) 

using B(t„|t ) = \ where I is the identity map. Since 
B9. v *B£ ,, > = B£ ,. \ *Bf. ,. s = I, we conclude that 

(*/l**J (til*/) ' 

inverse maps are canonical maps. Canonical maps have 
the composition property from Eq. (|20|) and have an in- 
verse from Eq. (|2ip . forming a one parameter group in 
time. They preserve the trace and Hermiticity, but they 
are in general not positive and are only valid within their 
compatibility domain. This is what we wanted: a map 
that allows for correlations with the environment such 
that any incompatible state with the correlations will 
give an unphysical total state. If we had full knowledge 
of the time dependence of the canonical dynamical map, 
it would be fully irreversible. Only some canonical maps 
B(" t /| t ) (the unitary map) might be completely positive 
for any choice of t and t' . The derivative of the canonical 
dynamical map is also well defined for all times. 

The canonical dynamical map we have defined describe 
the most general dynamics of an open quantum systems 
with out the need for the Markov approximation. In the 
next part, we show the connection between the total uni- 
tary dynamics and the correlations with the environment 
to the reduced dynamics given by the cannonical dynam- 
ical map. 



D. Canonical Embedding Map 




N 



FIG. 1: This diagram represents the evolution described by 
Eq. ((T8j). CP is Completely Positive evolution, N is Not 
Positive Evolution. A canonical dynamical map from ti — » ti 
can be defined going to to, and from there forward to £2, as 
in Eq. fity . 

the state from t\ to to using the inverse map, then evolve 
the state forward to t%. We write this as 



$ f«2|tl) 



%|*o) * B («o|ti)- 



(19) 



The composition is easily computed in the A form of the 
map. From Eq. (|19p . the canonical dynamical maps have 
the composition property: 



3 (t/|t. 



(20) 



The canonical dynamical map is connected to the re- 
duced evolution of the system and the environment. To 
go from the reduced system state, to the total evolution 
we need to invert the trace at all times. We had used 
an embedding map E ti that could consistently invert the 
trace map T for states uncorrelated at time tj. For clar- 
ity, we will focus only on the embedding from Eq. (|8|) 
for initially uncorrelated states. Even so, this procedure 
also work for any valid embedding (completely positive 
or not completely positive) such as the ones proposed by 
Pechukas |l4[ and Alicki [23j . With the use of the canon- 
ical map, we can generalize these embedding maps to all 
times, even when the initial correlations have evolved, 
such that: 

77(f) -> 77(f) = p(t) for all t. 

Such an embedding map will use the history of the re- 
duced evolution to "close" the open system. We evolve 
the state backwards to the time where we had defined a 
valid embedding map, undo the trace, and unitarily go 
forward. From Eq. ([5]), this would be pictorically repre- 
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sented by: 

%|to) 

P (to) P(t) = K v (t) 

Et„ 1f T 
»?(to) »?(*)• 

M (to\t) 

This canonical embedding map from ?7(i) — ► is de- 
fined as: 



U(t| 



in) 



^tolt) 



(22) 



The canonical embedding map preserves Hermiticity 
and trace, but might not be positive. Its compatibility 
domain corresponding to the system space compatible 
with the correlations existing at time t. The set of states 
that will give unphysical evolutions is also incompatible 
with the memory effects of the environment. 

We do not need an embedding map for an uncorrelated 
total state at to; any valid embedding for any other time 
t will do. This is proven by: 



Kr = 



U (t | to ) *E to *B (to | t) , 



%)*(%w* E fe*%it')J* B ra 



(23) 



By knowing one embedding map for a time t' and the uni- 
tary operator in the interval [t,t'], any other embedding 
for another t can be found. 

This approach explicitly shows the connection between 
the correlations of the state with the environment and its 
history. Correlations at one time can be changed to cor- 
relations at another as long as the history is known. The 
necessity of additional knowledge to establish an embed- 
ding map makes it non-Markovian. The possible nega- 
tivity of the map shows that the history limits some of 
the states in the system space to be compatible with the 
total system-environment state. Detailed knowledge of 
the reduced dynamics can be used to find the full dy- 
namics (ill, Hj]. The embedding map will be used as 
a mathematical device to connect the full dynamics to 
those of the reduced space without need of the Markov 
approximation. 



E. Example 



We return to the example from Section III CI to illus- 
trate how to compute an inverse map, then the canon- 
ical dynamical map and the embedding map. We want 
to map the Bloch vector ~~a from the final time tf to 
the initial time tj. In its affinc form this is: a (tj) = 



R 



(a (tf) — r ). For the particular example from 



found from the dynamics, 

1 + c" 2 
if 2 

Ht«\t) 



1 



1 





2c- 2 
2c~ 2 
1 



By index exchange, we obtain B( to | t ), which in the eigen- 
system representation is: 

Ao(i-io) = ^(l + 3c- 2 ), Co = ^U, 

Al,2, 3 (t-£o) = ^(l-C- 2 ), 01,2,3 = ^1,2,3- (24) 

For certain values of t, B is not completely positive. This 
represents the periodic behavior of the original map: as 
the state is squeezed, the compatibility domain of its in- 
verse maps also shrinks. For the times where c = 0, the 
only compatible state is the center of the Bloch sphere. 
States outside the compatibility domain are not relevant 
to the physical dynamics of the open system. They are 
inconsistent with the developed correlations and history. 

We can define the canonical dynamical map by means 
of Eq. (TO} . The composition property is easier to apply 
on the A form of the map, since it is matrix multiplica- 
tion. We compute A( t /| to ) • A( to | t ) = A( t /| t ), then exchange 
the indices to obtain the B c form of the canonical map, 
that has as its eigensystem: 



Xo(t'-t) = 
Ai, 2 ,3(i'-*) 



1 



f 



c 



Co- 

Ci 2,3 



1 

"71 



Eq. (JUJ, ~a(0) = jz~a(t). The inverse 



H*o|t) 



can be 



where c = cos(t' — to) and c = cos(i — to). With t = to 
the map is completely positive. Taking t' — t gives the 
inverse map. 

Finally, a canonical embedding map can be computed 
from Eqs. ©, (23} and (33}: 

(»?(*)) = U m) ([B^ (»?(*))] ®r) U} tlt0) . 

From Eq. (TO}, with rj(t) = \ (1 + CLj(t)o-j) and r = ±1, 
we carry out the calculation to reach the final result: 

E t(v{t))=2 l®l + Oj(i)(o-ji8l 
+ tan(t) 2 l ® (Tj + tan(t) (a k <g> a t - 07 ® a k )^ , (25) 

summing over index j, with {j, k, 1} being cyclic. The 
compatibility domain is represented here by the un- 
bounded character of tan(t). Periodically the compat- 
ible set of vectors a (t) tend to the center of the Bloch 
sphere. The compatible system parameters change peri- 
odically with the correlations. 

In the next section, we show how the derivative of the 
canonical dynamical map is related to the embedding 
map. 
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V. NON-MARKOVIAN MASTER EQUATION 



A. Example 



The non-Markovian master equation can be derived 
from the canonical dynamical map from Eq. (fT9"l) . The 
time derivative of the unitary operator is U = —iHU, so 
it follows that the time derivative of the canonical map 



-iTr£ 
-iTr £ 



This is equivalent to a von Neumann equation of the 
reduced system space, Ti£ [p(t)] = —iTr £ [H, p(t)]. To 
show how the differential equation can explicitly depend 
only on the system space, we use the embedding map 
from Eq. (|22p . The differential equation is: 



d_ 

at 



-iTif 



Now, we write the total Hamiltonian as H = Ho + Hj, 
where Ho is the local (system) part of the Hamiltonian. 
This local part acts through the embedding map leaving 
it unchanged. With this, we have the standard form of 
the non-Markovian master equation: 



9 , s 



HoMt) +M T >{t) 



with Kf(-) = F t (-) +!{(•), where 



F t (- 
F t f (- 



= -iTr £ [HrEf(.)} 
= +iTi £ [E^(-)Hj] 



(26) 



(27) 



The embedding map here is just a mathematical device 
that allow us to show that the Hermitian super-operator 
K t is related to the time derivative of the canonical dy- 
namical map by: 



I' 



-i[H c 



*(•)• 



(28) 



The Ho term is the Hamiltonian evolution of the system 
and K( carries all the effects of the environment, includ- 
ing dissipation and memory. 

Since the environment is finite-dimensional, there will 
be some quasi-periodicity to this evolution as informa- 
tion goes from the system to the environment, and back. 
At certain times the space is being contracted, while at 
others it is expanded. These Poincare recurrences are 
a consequence of the canonical maps forming a group. 
This should be contrasted to the Kossakowski-Lindblad 
master equation, that uses the Markov approximation to 
obtain a dynamical semigroup. The Markovian master 
equation can be obtained by rescaling K t to be time in- 
dependent. 

The non-Markovian master equation is generalization 
of the von Neumann equation to open quantum systems. 



We will complete the example from Section IIVEI to 
illustrate the consistency of Eq. ([2"B"jl . In this case, Ho = 
0, Hj = ^J2j a j ® a j an d ^t(v(t)) was calculated in 
Eq. ((251). I n tnis case ; horn Eq. ([27]) becomes 

F t( r K^)) = ^2 j( - «tan(i) 2 - 2tan(t))a,-(t)<Tj. 



The non-Markovian master equation is then: 

r,{t) = K t (77(f)) = -^tan(*K(i)^, 

3 

= 2tan(t)(l-2i7(t)Y (29) 



If we only look at the <jj component, the evolution of its 
expectation value is: 

dj(t) = —2t&n(t)a,j(t), 

and has as solution a 3 -(t) = cos(t — to) 2 a,j(to). This which 
agrees with the starting point from Eq. (|11[) . 

This is an example of how the total evolution and the 
non-Markovian dynamical map are related to each other. 
Similarly, if we know the first derivative of the evolution, 
as in Eq. (|2"9"]) , partial knowledge of the multiplication 
of Hj and K t can be determined from Eq. ([27]) . Higher 
derivatives of the canonical map may yield even more 
information of the full dynamics. 

Note that there is no dissipation in this equation be- 
cause we allow for Poincare recurrences. In the next sec- 
tion we discuss how partial knowledge of the evolution 
leads to decay beyond thermodynamic equilibrium. 



VI. NON-EQUILIBRIUM QUANTUM 
THERMODYNAMICS 



The Kossakowski-Lindblad master equation for a pro- 
cess may be obtained by taking the Markov approxima- 
tion of the dynamical map of that process. From this ap- 
proximation, irreversibility is introduced and relaxation 
into thermodynamic equilibrium obtained. Exponential 
decays are natural solutions to many instances of this 
equation. 

However, the non-Markovian master equation from 
Eq. (|28p allows us to know the full evolution of the sys- 
tem without irreversibility. Thermodynamic effects can 
be introduced by expanding K t for short times without 
the need of the Markov approximation. As larger or- 
ders in time are introduced to the approximation, longer 
memory effects and higher order correlations with the 
environment appear. Higher orders in time allow us to 
go beyond the thermodynamic regime; non-equilibrium 
quantum thermodynamical effects can be studied. We 
illustrate this with an example. 
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A. Example 

The master equation from the example in Section IV Al 
is not only non-Markovian, it is also periodic. To intro- 
duce some dissipation and decay, and connect it to non- 
equilibrium thermodynamics, we must make an approxi- 
mation for short times in the master equation. Now only 
memory effects of a small order in time will be kept as the 
approximation discards some knowledge of the evolution. 
Irreversibility arised from the limited information. 

Experimentally, limited information comes from mon- 
itoring the system for only time shorter that Poincare 
time, and trying to find the master equation from this 
incomplete information. It can also come from knowing 
the dynamics of the reduced system to a limited number 
of derivatives only. 

We approximate tan(i) w t and Eq. (|29p becomes: 

r,(t)=2t(t-2r,(t)). 

The evolution of just one component is, <ij(t) = 
— 2t aj(t). The solution to this differential equation is 

a j (t-to)=e-^- to ^a j (t ). (30) 

As time goes to infinity, the polarization of the Bloch 
vector shrinks to zero through a non-exponential decay 
due to the short-time memory effects retained from the 
environment. In other words, the environment is not an 
ideal (passive) thermodynamic bath as it is dynamically 
allowed to react slightly. This is an example of a non- 
equilibrium quantum thermodynamical effect. The decay 
of the form e _t from Eq. (|30|) should be contrasted 
to the thermodynamic decay e~ 7t from Eq. (|16p . The 
non-equilibrium thermodynamic decay can be faster than 
exponential for very small values of 7, while it can be 
slower for large values of 7. At intermediate values, 7 « 
1, the non-Markovian decay is slower than exponential 
at first, and then much faster. Accounting for memory 
effects can make decays faster or slower. 

The non-Markovian decay also differs from exponential 
decay close to the initial time. In this non-equilibrium 
thermodynamic solution, the initial time derivative of 
the polarization is zero, which is crucial to obtaining 
the quantum Zeno effect [26j]. Before, quantum Zeno 
could be obtained only from the Hamiltonian part of the 
Kossakowski-Lindblad master equation. Now, even the 
interaction with the environment can give rise to a Zeno 
region. 

VII. DISCUSSION AND CONCLUSIONS 

We have developed a generalized non-Markovian mas- 
ter equation for open quantum systems by accounting 
for correlations with the environment. Previous work on 
completely positive non-Markovian master equations can 
be treated as special classes of the non-markovian master 



equation in this paper. For example, Shabani and Li- 
dar proposed a class of master equations whose memory 
comes from total states with correlations derived from 
measurement approach Q. This is equivalent to hav- 
ing an embedding map from Eq. (|23[) for the particu- 
lar time t' given by a measurement on the environment. 
From this, a canonical embedding equation can be devel- 
oped for all times, and their master equation obtained. 
This class of embedding is completely positive, at the 
expense of limiting to only classical correlations of the 
environment with the system at time t' fl8l [H| . Breuer 
proposes another class of embedding maps for a differ- 
ent restricted kind of correlations that come from the 
projection-operator method 10]. Our approach permits 
any kind of correlations, classical or quantum. 

In conclusion, we have discussed how not completely 
positive dynamical maps in open quantum systems rep- 
resent the limited domain due to correlations with the 
environment. With this, a canonical dynamical map was 
developed that can be applied for any initially correlated 
systems. The canonical dynamical maps form a dynam- 
ical group, different from the dynamical semigroup from 
the Kossakowski-Lindblad equation. A canonical embed- 
ding map can be constructed to express the correlations 
with the environment at any time, effectively closing 
the evolution of the open system. A generalized non- 
Markovian master equation was constructed that was lo- 
cal in time and corresponds to the reduced-space von 
Neumann equation. Approximations to this equation, 
such as the ones given by a limited knowledge of the 
history, or knowledge of the evolution of the system to 
a small order in time, can lead to irreversible behavior 
beyond the purely thermodynamic regime. This theory 
permits the study of non-equilibrium quantum thermo- 
dynamic effects. 

We would like to thank A. Shaji, T. Tilma, K. Modi 
and M. Mohseni for insightful discussions. We are also 
grateful to A. Chimonidou and K. Dixit for their com- 
ments and corrections to the manuscript, and D. Miracle 
for massive help with the editing. 



APPENDIX A: CLASSICAL STOCHASTIC 
PROCESSES 

A classical probability vector ~p(i) can be evolved into 
another one, p (/), by means of a matrix M using the 
equation, 

The probability vectors form a convex set; for a finite 
number of nonzero components it is a simplex. If the vec- 
tors are written in tensor notation, the evolution is fully 
determined by p(f) r ' = M r ' ir p(i) r . If M is treated as a 
map, it must have as its domain all probability vectors 
{ P (*)}) an d as its image a subset of the domain. Matri- 
ces with these properties are called stochastic matrices. 
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The only stochastic maps that are invertible for the whole 
domain are the permutations of the vertices of the sim- 
plex. These stochastic matrices, whose inverse happen 
to be also a stochastic matrix, correspond to maps whose 
domain and image are the whole set {"??}. They form a 
special subclass called bi-stochastic matrices. If an in- 
verse is desired for more general cases, caution must be 
taken on where it acts. The pseudo-inverse of a stochas- 
tic matrix M, such that M • M = I might itself not be 
a stochastic matrix. M is properly defined only on the 
subset of probability vectors of the form M • ~p for all 
{ -p }■ 

The probability vectors can be evolved as a process in 
time with a stochastic map, p(tf) = M( t/ | ti ) • p(U). If 
p (tf) depends only on the particular state p (U), it is 
said to be a Markov process. Markovian processes corre- 
spond to the loss of information in a mononotonic fash- 
ion. Sometimes a process N for a time interval [ti — » tf] 
must be defined using outside variables r (ti). If so, the 
process is described by ~~q(tf) = Nr t ,\ ti ) (r (ti)) ■ ~~q(ti) 
and is said to be non-Markovian. The additional vari- 
ables ~r could represent the state ~q(t) at other times 
t 7^ ti, and may be referred to as memory effects or his- 
tory. In such a case, the knowledge of ~r is the history 
needed to consistently define N. 

A Markovian process in ~p can be made non- 
Markovian in ~~q by reducing the space of known param- 
eters: 

Markovian: ~p(tf) = M( t/ | t .) • p (U) 
I 

Non-Markovian: ~q(tf) = N( t/ | t .) (^r*(ti)j ■ ~q(ti). 

On the other hand, this non-Markovian process N may 
be mapped into a Markovian process M by extending the 
space from ~~q(ti) to ~p(U) = {~q '(ti) ,~r (ti)} . This would 
require additional knowledge of the process. In general, 
~q are correlated to ~~r . Not all ~~q are permitted; they 
must be compatible with their corresponding r . 

A physical example is the process of classical scatter- 
ing of multiple particles. This is a Markovian evolution 
in position and momentum variables; if integrated over 
momentum variables, correlations with it are now folded 
into a memory kernel that leads to non-Markovian ef- 
fects. A method that extends the space to get from 
non-Markovian phenomena to Markovian by studying the 
time evolution of the position variables was computed for 
scattering particles in (3(| . 



APPENDIX B: DERIVATION OF THE 
KOSSAKOWSKI-LINDBLAD MASTER 
EQUATION FROM THE DYNAMICAL MAP 

We derive the Kossakowski-Lindblad master equation 
from the dynamical map following the procedure given in 
[37l | and using the assumptions and approximations dis- 
cussed in Section IIIII The Kossakowski-Lindblad master 
equation was derived originally for completely positive 
evolutions, such that < A Q in Eq. (fj|. With it, we can 
write: 



a/AoCo ps t + \/tL n , 
\f~KxC a ~ \ft L a for a > 0. 

The action of the map for small t is: 



(Bl) 



r)(t) = (a + Vt L ) 17(0) (i + Vt L ) f 

+ 5^tL Q)? (0)Lt. (B2) 



a>0 



Using the trace preservation condition J2 a AqC^C c 
we find the property: 



Lo)=-E 



L„L C 



With this, Eq. (|B2[) can be rewritten as: 



r)(t) - r,(0) 



1 

2Vt 



L - L$, 77(0) 



^([!W0),LtJ + [L a) tfOjLt]). (B3) 



Looking at Eq. (|B3[) we note that Lo — Lq is anti- 
Hermitian and could be written as Lo — Lq = —i\fiH, 
The Hermitian operator H has now been rescaled by a 
factor of y/t to implicitly carry a time dependence. With 
this, and taking the limit of Eq. (1B3|) where t — * 0, the 
Kossakowski-Lindblad master equation from Eq. (|15p is 
obtained. It corresponds to a Markovian process where 
H is the (rescaled) effective local evolution, resembling 
a Hamiltonian, while L Q are the operators that generate 
the completely positive dynamical semigroup @, H, 0). 
Dynamical semigroups are not groups as they do not have 
an inverse. Their irreversibility are consequence of all the 
assumptions and approximations. 
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